Cognitive engineering in aerospace applications

The progress that was made with respect to the objectives and goals of the research that is being carried out in the Cognitive Systems Engineering Laboratory (CSEL) under a Cooperative Agreement with NASA Ames Research Center is described. The major objective of this project is to expand the research base in Cognitive Engineering to be able to support the development and human-centered design of automated systems for aerospace applications. This research project is in support of the Aviation Safety/Automation Research plan and related NASA research goals in space applications

Phonological Processing in Human Auditory Cortical Fields

We used population-based cortical-surface analysis of functional magnetic imaging data to characterize the processing of consonant–vowel–consonant syllables (CVCs) and spectrally matched amplitude-modulated noise bursts (AMNBs) in human auditory cortex as subjects attended to auditory or visual stimuli in an intermodal selective attention paradigm. Average auditory cortical field (ACF) locations were defined using tonotopic mapping in a previous study. Activations in auditory cortex were defined by two stimulus-preference gradients: (1) Medial belt ACFs preferred AMNBs and lateral belt and parabelt fields preferred CVCs. This preference extended into core ACFs with medial regions of primary auditory cortex (A1) and the rostral field preferring AMNBs and lateral regions preferring CVCs. (2) Anterior ACFs showed smaller activations but more clearly defined stimulus preferences than did posterior ACFs. Stimulus preference gradients were unaffected by auditory attention suggesting that ACF preferences reflect the automatic processing of different spectrotemporal sound features

Cognitive consequences of clumsy automation on high workload, high consequence human performance

The growth of computational power has fueled attempts to automate more of the human role in complex problem solving domains, especially those where system faults have high consequences and where periods of high workload may saturate the performance capacity of human operators. Examples of these domains include flightdecks, space stations, air traffic control, nuclear power operation, ground satellite control rooms, and surgical operating rooms. Automation efforts may have unanticipated effects on human performance, particularly if they increase the workload at peak workload times or change the practitioners' strategies for coping with workload. Smooth and effective changes in automation requires detailed understanding of the congnitive tasks confronting the user: it has been called user centered automation. The introduction of a new computerized technology in a group of hospital operating rooms used for heart surgery was observed. The study revealed how automation, especially 'clumsy automation', effects practitioner work patterns and suggest that clumsy automation constrains users in specific and significant ways. Users tailor both the new system and their tasks in order to accommodate the needs of process and production. The study of this tailoring may prove a powerful tool for exposing previously hidden patterns of user data processing, integration, and decision making which may, in turn, be useful in the design of more effective human-machine systems

Total internal reflection Raman spectroscopy

Total internal reflection (TIR) Raman spectroscopy is an experimentally straightforward, surface-sensitive technique for obtaining chemically specific spectroscopic information from a region within approximately 100–200 nm of a surface. While TIR Raman spectroscopy has long been overshadowed by surface-enhanced Raman scattering, with modern instrumentation TIR Raman spectra can be acquired from sub-nm thick films in only a few seconds. In this review, we describe the physical basis of TIR Raman spectroscopy and illustrate the performance of the technique in the diverse fields of surfactant adsorption, liquid crystals, lubrication, polymer films and biological interfaces, including both macroscopic structures such as the surfaces of leaves, and microscopic structures such as lipid bilayers. Progress, and challenges, in using TIR Raman to obtain depth profiles with sub-diffraction resolution are described

Learning from Automation Surprises and "Going Sour" Accidents: Progress on Human-Centered Automation

Advances in technology and new levels of automation on commercial jet transports has had many effects. There have been positive effects from both an economic and a safety point of view. The technology changes on the flight deck also have had reverberating effects on many other aspects of the aviation system and different aspects of human performance. Operational experience, research investigations, incidents, and occasionally accidents have shown that new and sometimes surprising problems have arisen as well. What are these problems with cockpit automation, and what should we learn from them? Do they represent over-automation or human error? Or instead perhaps there is a third possibility - they represent coordination breakdowns between operators and the automation? Are the problems just a series of small independent glitches revealed by specific accidents or near misses? Do these glitches represent a few small areas where there are cracks to be patched in what is otherwise a record of outstanding designs and systems? Or do these problems provide us with evidence about deeper factors that we need to address if we are to maintain and improve aviation safety in a changing world? How do the reverberations of technology change on the flight deck provide insight into generic issues about developing human-centered technologies and systems (Winograd and Woods, 1997)? Based on a series of investigations of pilot interaction with cockpit automation (Sarter and Woods, 1992; 1994; 1995; 1997a, 1997 b), supplemented by surveys, operational experience and incident data from other studies (e.g., Degani et al., 1995; Eldredge et al., 1991; Tenney et al., 1995; Wiener, 1989), we too have found that the problems that surround crew interaction with automation are more than a series of individual glitches. These difficulties are symptoms that indicate deeper patterns and phenomena concerning human-machine cooperation and paths towards disaster. In addition, we find the same kinds of patterns behind results from studies of physician interaction with computer-based systems in critical care medicine (e.g., Moll van Charante et al., 1993; Obradovich and Woods, 1996; Cook and Woods, 1996). Many of the results and implications of this kind of research are synthesized and discussed in two comprehensive volumes, Billings (1996) and Woods et al. (1994). This paper summarizes the pattern that has emerged from our research, related research, incident reports, and accident investigations. It uses this new understanding of why problems arise to point to new investment strategies that can help us deal with the perceived "human error" problem, make automation more of a team player, and maintain and improve safety

Cognitive engineering in aerospace application: Pilot interaction with cockpit automation

Because of recent incidents involving glass-cockpit aircraft, there is growing concern with cockpit automation and its potential effects on pilot performance. However, little is known about the nature and causes of problems that arise in pilot-automation interaction. The results of two studies that provide converging, complementary data on pilots' difficulties with understanding and operating one of the core systems of cockpit automation, the Flight Management System (FMS) is reported. A survey asking pilots to describe specific incidents with the FMS and observations of pilots undergoing transition training to a glass cockpit aircraft served as vehicles to gather a corpus on the nature and variety of FMS-related problems. The results of both studies indicate that pilots become proficient in standard FMS operations through ground training and subsequent line experience. But even with considerable line experience, they still have difficulties tracking FMS status and behavior in certain flight contexts, and they show gaps in their understanding of the functional structure of the system. The results suggest that design-related factors such as opaque interfaces contribute to these difficulties which can affect pilots' situation awareness. The results of this research are relevant for both the design of cockpit automation and the development of training curricula specifically tailored to the needs of glass cockpits

Breaking down barriers in cooperative fault management: Temporal and functional information displays

At the highest level, the fundamental question addressed by this research is how to aid human operators engaged in dynamic fault management. In dynamic fault management there is some underlying dynamic process (an engineered or physiological process referred to as the monitored process - MP) whose state changes over time and whose behavior must be monitored and controlled. In these types of applications (dynamic, real-time systems), a vast array of sensor data is available to provide information on the state of the MP. Faults disturb the MP and diagnosis must be performed in parallel with responses to maintain process integrity and to correct the underlying problem. These situations frequently involve time pressure, multiple interacting goals, high consequences of failure, and multiple interleaved tasks

Functional Properties of Human Auditory Cortical Fields

While auditory cortex in non-human primates has been subdivided into multiple functionally specialized auditory cortical fields (ACFs), the boundaries and functional specialization of human ACFs have not been defined. In the current study, we evaluated whether a widely accepted primate model of auditory cortex could explain regional tuning properties of fMRI activations on the cortical surface to attended and non-attended tones of different frequency, location, and intensity. The limits of auditory cortex were defined by voxels that showed significant activations to non-attended sounds. Three centrally located fields with mirror-symmetric tonotopic organization were identified and assigned to the three core fields of the primate model while surrounding activations were assigned to belt fields following procedures similar to those used in macaque fMRI studies. The functional properties of core, medial belt, and lateral belt field groups were then analyzed. Field groups were distinguished by tonotopic organization, frequency selectivity, intensity sensitivity, contralaterality, binaural enhancement, attentional modulation, and hemispheric asymmetry. In general, core fields showed greater sensitivity to sound properties than did belt fields, while belt fields showed greater attentional modulation than core fields. Significant distinctions in intensity sensitivity and contralaterality were seen between adjacent core fields A1 and R, while multiple differences in tuning properties were evident at boundaries between adjacent core and belt fields. The reliable differences in functional properties between fields and field groups suggest that the basic primate pattern of auditory cortex organization is preserved in humans. A comparison of the sizes of functionally defined ACFs in humans and macaques reveals a significant relative expansion in human lateral belt fields implicated in the processing of speech

Surfactant adsorption by total internal reflection Raman spectroscopy. Part III: Adsorption onto cellulose

TIR Raman spectroscopy has been used to study the adsorption of surfactants onto cellulose. The cellulose was prepared by Langmuir–Blodgett deposition of trimethylsilylcellulose onto silica followed by removal of the trimethylsilyl groups with acid to generate a hydrophilic surface. The reaction was followed in situ with Raman spectroscopy, revealing a two-step hydrolysis. Adsorption isotherms of hexadecyltrimethylammonium bromide (CTAB) and Triton X-100 (TX-100) on hydrophilic cellulose were obtained by TIR Raman scattering under quasi-equilibrium conditions where the bulk concentration was slowly but continuously varied. The isotherms of both surfactants are almost linear, in contrast to the isotherms on hydrophilic silica. The CTAB isotherm shows hysteresis depending on whether the concentration of the surfactant is increasing or decreasing due to a slow adsorption region. A mixture of TX-100 and CTAB shows ideal adsorption, in contrast to adsorption of the same mixture on silica where there is a strong cooperative interaction at low CTAB surface coverage